Neural architecture and function

How much does Neural network architecture determine or constrain its function?

Rodriguez2019optimal studies the relationships between the modularity of a reservoir computer (Echo state network) and its memory capacity.

Gaier2019weight argues that we can find neural network architecture that can inherently perform certain tasks without training the weights.

You2020graph explores this question by developing a relational graph representation.